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1 Stochastic choice and stochastic rationality 


In the standard theory of rational choice we start with a set X of alternatives, a family 
B of nonempty budgets (subsets of X), and a choice function c: B+> c(B) Cc B. In one 
model of stochastic choice a single element of B is chosen at random.'! So instead of a 
subset of B the “choice” gives us a probability measure on B. 


Let p(C|B) denote the probability that the choice from B belongs to C. 


Of course we require that p(B|B) = 1 for all B € B. This notation is intentionally 
reminiscent of the notation for the conditional probability C given B, which it may not 
be, but I don’t think you will get confused here. When C and/or B are itemized, we may 
simply omit the braces. For example, we may write p(z|x,y) instead of the cumbersome 


p({x}l{x, y}). 





To keep things simple, we shall assume that _X is finite. 











A special kind of stochastic choice is derived from a stochastic preference. Let P 
denote the set of linear preference relations on X. (A preference relation > is linear if 
it is total, transitive, irreflexive, and asymmetric.) The set P is also finite, having |X|! 
elements. We may when convenient refer to a preference relation by listing its “skeleton.” 





“These notes expand upon Exercise 1.D.5 in Mas-Colell-Whinston—Green [8, p. 16], and are a sim- 
plified (I hope) exposition of some results in McFadden and Richter [10]. 

lThere are other models of stochastic choice. We could, for instance, assume that a subset of B is 
chosen at random. Indeed McFadden and Richter [10] consider an entirely general framework. The case 
considered here is both natural and simple. 
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For instance, if X = {x,y,z}, we may write z>az>z to refer to the unique linear 
preference > satisfying z> x > z. 

A stochastic preference is a probability measure on P.? A stochastic preference 
gives rise to a stochastic choice as follows. Given a linear preference > on X and budget 
B, let 

>(B) = the (unique) >-maximal element of B. 


1 Definition For the purposes of this note, a stochastic choice (X,B,p) is stochasti- 
cally rational if there is a stochastic preference 7 on P such that for all B € B, 


p(2|B) =1({> € P: 2 =>(B)}). 
In this case we say that 7 rationalizes p. 


The next example shows that not every stochastic choice can be rationalized by a 
stochastic preference. It appears as Exercise 1.D.5 in Mas-Colell-Whinston-Green [8, 
p. 16]. 


2 Example Let X = {x,y,z}, and let B be the set of all two-element subsets of X. 
Then the stochastic choice 


p(2|z,y) = 4, plylz,y) = 4 
piyly,z)=%, plzly,z) = 4 (1.1) 
p(z|z,z) = 4, p(alz,z) =} 


is stochastically rational, and is rationalized by 7 where (>) = 1/6 for each > € P. 


But the stochastic choice 


p(a|z,y) = 2, plylz,y) = 4 
p(yly, 2) = 3, plzly,z) = 4 qd?) 
plz|z,z) = 3, plele,2)=7 


is not stochastically rational. Perhaps the simplest way to see this is to note that if z> x, 
then there are three choices for where y fits in the preference order: y> z>2, z>y>2, 
or z>a>y. In any event, y> az or z>y (or both). In other words, 


{> EP:z>a}c{>eEP:z>y}U{> EP: y>z}. 





2A more general, and more complicated, model would allow indifference. 
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But if p is rationalized by some probability 7 on P, then (1.2) implies that left-hand 
side of the inclusion has probability 3/4, while the union on the right-hand side has 
probability at most 1/4 + 1/4, a contradiction. 


Both (1.1) and (1.2) are special cases of the following stochastic choice. 


p(z|tz,y)=a, plylz,y)=l-—a 
p(yly,z) =a, plzly,z)=1l-a (1.3) 
p(z|t,z)=a, p(z|z,z)=1l—a 


So when is this stochastically rational? The answer is, whenever 
1/3 <a < 2/3. 
First we show that this condition is necessary. The same argument used above, namely 
{-~EP:z>a}c{>EeP:z>y}Uf> EP: y>az} 
shows that a necessary condition is that a < 2(1— a), or a < 2/3. But 
{>EP:y>a}ec{>EeP:y>z}U{> EP: z>z} 


implies that 1—a < 2a, or 1/3 < a. To show sufficiency, it is enough to exhibit a 7 that 
rationalizes p. So assume 1/3 < a < 2/3, and set 


nary>z)=alyr2>s) =a(2>2>y) =a—1/3 
reHe y= ny a2) = ae ey ee) 2d — oe, 














Simple arithmetic shows that this 7 rationalizes p. 


2 The Axiom of Revealed Stochastic Preference 


The natural follow-up question is what properties must a random choice p satisfy in order 
to guarantee that it is rationalized by some random preference 7? 

We shall prove that stochastically rational choice functions are characterized by the 
following axiom, which McFadden and Richter [10] dub the Axiom of Revealed Stochastic 
Preference, or ARSP for short. 
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3 Axiom of Revealed Stochastic Preference A stochastic choice (X,B,p) satis- 
fies the ARSP if for every finite sequence (Ci, Bi),...,(Cn, Bn) (where repetitions are 
allowed) with each B; € B, and each C; C B; is nonempty, 


S> p(C;|B;) < max S°1(>, Cj, Bj) (2.1) 
jal re? 
where 
1 if >(B) EC 
i668) = 
0 otherwise. 


Or to put it another way that makes the repetitions explicit, let {(C;, Bj) : i = 
1,...,N} be an enumeration of all the distinct pairs (C,B) such that @ACCBEB. 
Then for every tuple (k;)_, of nonnegative integers, 


N N 
i=1 ae | 

The right-hand side of (2.1) begs for some comment. What it does is find a single 
preference relation that would choose an element of C; from 6; for the most 7. The 
remarkable thing is that an upper bound on the sum of the probabilities is given by the 
number of choices a single preference relation would make. 


The ARSP looks very different in form from our standard revealed preference axioms, 
but it is not so alien as it first seems. Let’s apply it to the singleton-valued non-stochastic 
choice case. Let h: B + X be a singleton-valued choice function. Let us abuse notation 
slightly and write « = h(B) rather than {x} = h(B). Then 


1 ifh(B) eC 


0 otherwise 


p(C|B) = | 


is the corresponding {0, 1}-valued stochastic choice function. Let S be the strong direct 
revealed preference relation, defined, as you may recall, by x S y if for some budget 
Be 8, we have y € B,y #42, and x = h(B). Now assume 


1 5 oS Xg*+ S Lay; 


all the x; distinct,? and let B; be such that 2; = h(B;) and 2j41 € Bj, j=1,...,n—1. 





3The only thing the assumption of distinctness rules out is x, = 71, since if 2; = x; fori < j, we 
may simply omit x;,...,2;-1. We deal wi e possibility x, = x1 in the next sentence. 
imply it ; We deal with th ibilit in th t t 
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We now ask, can we have z,, S x? If so, let x, = h(B,) where x; € B,. Then 


n 


> p(a,|B;) =n. 


j=l 


Now consider any linear order >. Transitivity and irreflexivity rule out 71 >--->2@,> 2, 
sO 


» A 5 Be) < n—l. 
j=l 


Thus x, S x; implies that (2.1) is violated, so ARSP implies that 
top Be0 ee OL, => 72,5 Bis 
which is just the Strong Axiom of Revealed Preference! 


McFadden [9] discusses some additional intuition behind this axiom. 


4 Example Let’s apply the ARSP to Example 2. 
Consider the sequence 
({o}, {0, y}), Ly}. ty, 2k), {2h (x, 2). 
For this sequence the left-hand side of (2.1) is 
ata+ta=s3a 


Now consider the linear preference > given by «> y> z. The corresponding sum for the 
right-hand side of (2.1) is 


1(>, {x}, (2, y}) +1 (>, fy}, fy, zt) + 10>, {2}, {2 2}) =14140=2. 


By symmetry, this is the maximum value for the right-hand sum. Thus in order for (2.1) 
to hold it is necessary that 
3a<2, or a< 2/3. 


Similarly, for the sequence 


({u}, fa, u}), {2}, {y, 23), {a}. fe, 23), 
we see that (2.1) implies 
3(1-—a) <2, or 1/3 <a. 
Now we would like to show that if 1/3 < a < 2/3, then (2.1) holds. It is clear that 
a pair (C,B) with C = B contributes 1 to each side of (2.1), so we need only consider 


sequences of pairs of the form ({a}, {a, by). Even so, it’s not apparent how to proceed. 
I’ll postpone further discussion until after the proof. 
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3 Characterization of stochastic rationality 


5 Theorem (McFadden-Richter [10]) | A stochastic choice p is rationalized by a 
random preference 7 on P if and only it satisfies ARSP. 


Proof: (ARSP ==> stochastic rationality): We shall prove this part by contraposition. 

Let J be the set of all distinct pairs (C, B) with B € B and @ £C' C B. Construct 
the matrix with rows indexed by J, and columns indexed by ?. Now append a row of 
ones. Then p is rationalized by a random preference if and only if the following system 
of equations has a nonnegative solution 7 € R”. 


(C,B) | --- 1(>,C,B) 








So to prove the contrapositive, we assume that stochastic rationality fails—that 
is, (3.1) has no solution. By Farkas’ Lemma (see, e.g., Gale [4, Theorem 2.6, p. 44]), the 
alternative is that there exists a vector y = (. -- ,y(C, B),--- ; Yo) € R’ x R such that 








[--- ,y(C, B), ++ 540] =) 
1 
or writing it out, for each > € P, 
da ¥(C, B)U(>, C, B) + yo < 9, (3.2) 
(C,B)eEIJ 
and 
d— ¥(C, B)p(C|B) + yo > 0. (3.3) 
(C,B)e3 
Together (3.2) and (3.3) imply that for every > € P, 
d ¥(C,B)l>,C,B)< >) y(C,B)p(C|B) (3.4) 
(C,B)eI (C,B)eI 
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Let 
Jt ={(C,B)€J:y(C,B)>0} and J ={(C,B) €I:y(C,B) < O}. 
Then (3.4) becomes 
S> y(C,B)1(>,C,B)-— SY ly(C,B)|1(-,C, B) 


(C,B)es+ (C,B)eI- 


< >) y(C,B)p(C|B)— 7 |y(C, B)|p(C|B). 


(C,B)eI+ (C,B)eI- 


(3.5) 


Since this is a finite system of strict inequalities, if there is a solution y, then there is a 
solution where the coordinates of y are rational numbers. By multiplying by a common 
denominator, we can find a solution y with integer coordinates. Moreover every coefficient 
y(C, B) > 0 for (C,B) € J* and of course |y(C, B)| > 0 for (C,B) € I~. Define the 
nonnegative integers 
4 
K(C,B) = oe (C,B) eI 
W(C,B)| (C,B) er. 


Then we may rewrite (3.5) as 
SS k(C,B)l(+,C,B)- S> k(C,B)1(>,C, B) 
(C,B)eEI+ (C,B)EI- 


< S° k(C,B)p(C|B)-— > k(C,B)p(C|B). 


(C,B)eEI+ (C,B)eI- 


(3.6) 


Now observe that 1(>, C, B) = 1—1(>, B\C, B) and p(C|B) = 1—p(B\C|B), so (3.6) 


can be written as 


S° k(C,B)1(+,C,B)+ S> k(C,B)1(>,B\C,B) 


(C,B)eEI+ (C,B)eI- 
< Dd) A(C,B)p(C|B)+ >) k(C,B)p(B\ C|B). 
(C,B)eI+ (C\B)eI- 


(3.7) 


Now consider the finite collection consisting of k(C, B) instances of (C, B) for (C, B) € 
Jt and k(C, B) instances of (B \ C, B) for (C, B) € J~. Then since (3.7) holds for each 
> € P, we have a violation of (2.1’). This proves that if p is not stochastically rational, 
then ARSP is violated. That is, if p satisfies ARSP, then it is stochastically rational. 

(Stochastic rationality =» ARSP): We could run the argument in reverse to prove 
the converse, but a direct argument is more instructive. Assume that the probability 
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ma on P stochastically rationalizes the stochastic choice p, and consider the collection of 
distinct pairs (C;, B;)_, with k; instances of each. For each i, by stochastic rationality, 


p(Ci|Bi) = D0 a(>) - 10>, Ci, Bi) 


+EP 
so 
N N 
> kip(Ci|B:) = 90 i DS a(-) - 10>, G, By) 
i=l i=1 + eP 
>EP i=l 
N 
ra S- 1(>) (max kills Bi) 
eo 
>eEP i=1 
=1 
N 
= se kl(=,C,,23); 
which is just (2.1’). Thus stochastic rationality implies ARSP. i 


The proof is a bit disappointing because it does not seem to use at all the intuition 
from the example. It is possible that the symmetry in the example is atypical, and the 
reasoning there does not generalize well. I need to think hard about this. 


4 Effectivity 


The ARSP imposes infinitely many restrictions on a stochastic choice even when X is 
finite, so you might ask whether it is feasible to verify it. In fact, there is a computa- 
tional procedure for checking stochastic rationality directly in the finite case—the simplex 
method of linear programming. The system (3.1) of equations is of the form 


An =p (4.1) 
where p 2 0. Consider the following linear program. 
minimize 1-z subject to At+z=p, 720, z20. (4.2) 


The system (4.1) has a nonnegative solution 7 = 7 if and only if 7 =7,z=0Oisa 
solution of (4.2). In fact, if (4.1) has no solution, then the solution of the dual program 
will imply (3.2) and (3.3). The program (4.2) is ideally set up to solve with the simplex 
algorithm since 7 = 0, z = p is an obvious initial feasible point. 
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5 


Related literature 


Thurstone [11, 12] and Luce [7] do not frame the problem quite the same way we have, but 
their work paved the way for random utility models. McFadden [9] and Falmagne [3], 
address the question of stochastic rationality much as we have defined it. Gul and 
Pessendorfer [5, 6] take the alternatives themselves to be lotteries. There are many other 
related papers. McFadden [9] has an extensive bibliography and literature survey. 
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